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In quantum information theory it is generally accepted that quantum mutual information is an 
information-theoretic measure of total correlations of a bipartite quantum state. We argue that there 
exist quantum states for which quantum mutual information cannot be considered as a measure 
of total correlations. Moreover, for these states we propose a different way of quantifying total 
correlations. 
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I. INTRODUCTION 

In quantum information theory it is generally accepted 
that (i) total correlations of a bipartite quantum state are 
quantified by quantum mutual information (see e.g. 
li,,^,>5„4J„^,^,aO, 11, 12, 13, 14, 15, 16.,I7„I8„ai,l2a) 
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(ii) the total correlations T{p^^) can be decomposed into 
classical and quantum correlations (see e.g. [1,MSBH 

US, [m, US, [il Q [S [13, H d ) 



AB\ 



C{p 



AB\ 



Q{p 



AB\ 



(2) 



(iii) the quantum correlations arc dominated b y th e clas- 

. i|,[ii,M[i3) 



sical correlations (see e.g. [7, 8, 10, 12, 
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Notice that the quantum correlations are not only limited 
to quantum entanglement, because separable quantum 
states can also have correlations which are responsible for 
the improvements of some quantum tasks that cannot be 
simulated by classical methods [21), [2^ 121 H, [H, [H, H^l . 

However, there are some results that may raise doubts 
as to whether the statements (i), (ii) and (iii) hold for 
all p"^^ . In the following we briefly review and discuss 
a few of them. For example, it has been shown that 
there are quantum states for which statements (i) and (ii) 
cannot be simultaneously true, if quantum correlations 
are measured by relative entropy of entanglement while 
classical correlations are quantified by a measure based 
on the maximum information that could be extracted 
on one system by making a POVM measurement on the 
other one 0]. 

Recently, it has been shown that for certain quan- 
tum states the quantum correlations, as measured by 
entanglement of formation, exceed half of the total cor- 
relations, as measured by quantum mutual information. 



Q(p^^) > 5^(/0^^) [13 ■ If one assumes that state- 
ments (i), (ii) and (iii) hold for all p"^^ , then one con- 
cludes that entanglement of formation cannot be consid- 
ered as a measure of quantum correlations. However, 
if one assumes that entanglement of formation is a mea- 
sure of quantum correlations and statements (ii) and (iii) 
hold, then it can be shown that for these quantum states 
T{p^^)>I{p^^). 

Moreover, it has been shown that for certain quantum 
states quantum correlations, as measured by entangle- 
ment of formation, exceed total correlations, as measured 
by quantum mutual information, Q(/o"^^) > T{p^^) 
\rA\m- It means that entanglement of formation can- 
not be considered as a measure of quantum correlations, 
if one assumes that statements (i), (ii) and (iii) hold for 
all p^^ . However, if one assumes that entanglement of 
formation is a measure of quantum correlations and state- 
ments (ii) and (iii) hold, then again one comes to conclu- 
sion that for these quantum states T{p^^) > I{p^^). 

Furthermore, it has been shown that for some quan- 
tum states quantum correlations, as measured by en- 
tanglement of formation, exceed /(p"*^) — Q{p^^), i.e. 
Q(p'^^) > \l{p^^) [3- If one assumes that statements 
(i) and (ii) hold for all p"^^ , then one concludes that for 
these states Q{p'^^) > C{p^^). However, if one assumes 
that entanglement of formation is a measure of quantum 
correlations and statements (ii) and (iii) hold, then once 
again one comes to conclusion that for these quantum 
states r(p^^) > /(p-^^). 

The above examples show that statement (i) may not 
be true for all bipartite quantum states. It is clear that if 
we assume that it is true, then we immediately conclude 
that quantum mutual information must be a measure of 
total correlations also in the case when the quantum state 
has only classical correlations, i.e. 



c{p^^)^r{p-")^i{p-") 
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In the present paper, we show that this is not the case 
for some classically correlated quantum mixed states and 
therefore in general case quantum mutual information 
cannot be considered as a measure of total correlations 
of bipartite quantum states. 
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II. A TWO-QUBIT MIXED STATE 

Assume that Alice and Bob share a pair of qubits in 
the following state 

=a|00)(00| + (l-a)|ll)(ll|, (5) 

where a € (0, 1). This state cannot have quantum corre- 
lations because it is separable and qubit A (B) is in the 
state p'^(^) = a|0)(0|-|-(l-Q;)|l)(l| which is a mixture of 
orthogonal states |0) and Therefore, it is clear that 
the correlations between two orthogonal states of q ubits 
A and B can be purely classical (see e.g. [1, 0, UmI)- 

Suppose now that Alice and Bob measure two observ- 
ables Ma = ao|0){0| + aill)(l| and Mb = bo\0){0\ + 
&i 1 1) (1 1 , respectively. If the measurement outcome of Ma 
{Mb) is Qi {hi), then qubit A {B) is certainly in the state 
Therefore, it is clear that the classical correlations 
between two orthogonal states of qubits A and B are sim- 
ply correlations between two classical random variables 
A and B corresponding to the measurement outcomes of 
Ma and Mb , respectively. Notice that A and B are ran- 
dom variables with alphabets A ~ {oq, ai}, B = {&o, bi} 
and probability mass functions p^^^^ = [pf^'^'^], where 

pf''^^ — Tr[|z)(i|/3"^(-^)] denotes the probability that the 
measurement outcome of Ma {Mb) is Ui {bi). In the case 
under consideration, it can be shown that 

p"^ — {a,l — a), (6a) 
pB = (a, 1 - a). (6b) 

Assume now that first Alice performs a measure- 
ment of Ma and then Bob performs a measurement of 
Mb- If the measurement outcome of Ma is a^, then 
the post-measurement state of the system is given by 
pfB ^ ^ /)p^S(|^^^j| ^ jypA^ Therefore, the 

conditional probability that Bob's outcome is bj pro- 
vided that Alice's was a^ is p^^j^ = Tr[(/ (g) \j){j\)pf^] 
while the joint probability that the measurement out- 
come of Ma and Mb is and bj, respectively is given 
by pfj^ — Tr[(|i)(z| (g) \j){j\)p'^^]- In the case under con- 
sideration, it can be shown that 

•'■"' = \»T^={11) m 

and 

Thus, we see that random variables A and B are not in- 
dependent and therefore there exist classical correlations 
between qubits A and B in the state ([5]). 

Assume now, according to the statement (i) , that total 
correlations of a bipartite quantum state are quantified 
by quantum mutual information which is defined in for- 
mal analogy to classical mutual information as 

/(/^)=5(/) + 5(p^)-5(/^), (9) 



pA ^ pB\A Q pB 

1 

a — a 

1 

1-a 1 — " 1 l-a 

FIG. 1: This diagram shows that B = f{A) and therefore 
random variables A and B are perfectly correlated in the 
information-theoretic sense, despite the fact that in this case 
the mutual information can be arbitrarily small. 

where S{-) denotes the von Neumann entropy. Then, 
according to Eq. (j4|) the classical correlations between 
qubits A and B are measured by the quantum mutual 
information. In the case under consideration, it can be 
shown that I{p^^) is just classical mutual information 
of random variables A and B given by 

I{A:B)^Y.Pf^^^og,{p^^/{ptpf)) 

= -alogja- (1 -a)log2(l-a). (10) 

Therefore, we see that the classical correlations content 
of the quantum state (O can be arbitrarily small, as mea- 
sured by classical mutual information, because a G (0, 1). 

Now, we check if these correlations can be really ar- 
bitrarily small. From Eq. ([7|) it follows that if Alice's 
measurement outcome is a^, then Bob's one is bi, i.e. B 
is a one-to-one function oi A, B = f{A) (see Fig. [1]). It 
means that the random variables A and B and what fol- 
lows the states of qubits are perfectly correlated in the 
information-theoretic sense. Therefore, we see that in 
the general case quantum mutual information cannot be 
considered as a measure of total correlations in bipartite 
quantum states. 

Now, we show why the classical mutual information 
I{A : B) does not capture all the correlations be- 
tween random variables A and B, except the case when 
a = 1/2. We know that Shannon entropy of ran- 
dom variable B, H{B) = —^jPf^og2pf, is a mea- 
sure of Alice's a priori uncertainty about the measure- 
ment outcome of Mb and if the measurement outcome 
of Ma is tti, then Alice's uncertainty about the measure- 
ment outcome of Mb is changed, preferably reduced, 
to H{B\A = a,) = -EjPji^^og^Pji^- Therefore, 
the information she gained about the measurement out- 
come of Mb due to the measurement of Ma is given 
by H{B) — H{B\A = ai). Thus, the average informa- 
tion gain about the measurement outcome of Mb due 
to the knowledge of the measurement outcome of Ma is 
j:,PtiH{B) - H{B\A = a,)) = H{B) - H{B\A), and 
it can be shown that it is equal to I {A : B). Therefore, 
we see that the average information gain about one ran- 
dom variable due to the knowledge of other one can be 
arbitrarily small although they are perfectly correlated. 
Thus it is clear that classical mutual information is not 
a measure of correlations between two random variables, 
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it is rather a measure of their mutual dependency. 

This conclusion leads us to the following question: 
What is an information-theoretic measure of correlations 
between random variables A and Bl For a pair of ran- 
dom variables with identical probability mass functions 
Cover and Thomas 30] define it in the following way 



C{A,B) 



I{A : B) 
H{A) 



(11) 



In the case under consideration, p"^ ~ and it can be 
shown that I{A : B) = H{A), therefore C{A, B) = 1, i.e. 
A and B are perfectly correlated for all a G (0,1). In 
the next section we show how to extend this definition 
to the case when the probability mass functions are not 
identical. 



III. A TWO-QUTRIT MIXED STATE 

Assume now that Alice and Bob share a pair of qutrits 
in the following separable state 



pAB ^ -|ll)(ll| + -|20)(20| + -|22)(22| 



(12) 



in which orthogonal states of qutrits A and B are classi- 
cally correlated. Notice that = i|l)(l| -f ||2)(2| and 
pB ^ i|o)(0| + i|l)(l| + i|2)(2|. Suppose now that Al- 
ice and Bob measure two observables Ma — ao|0)(0| + 
ai|l)(ll+a2|2}(2landMB = 6o|0)(0|-f&i|l)(l|+62|2)(2|. 
It can be easily shown that the probability mass functions 
and p^ are not identical, and they are given by 



P 



P 
p' 



= fO i -) 



3' 3^ 
V3' 3' 3'- 



(13a) 
(13b) 



Assume now that first Alice performs a measurement 
of Ma and then Bob performs a measurement of Mg . It 
can be shown that 



B\A 

Po\i =0' 

B\A ^ 1 
^"012 ~ 2' 



B\A , 
Pl|l =1' 

B\A „ 
Pi 2 =0' 



B\A 
P2\l 

B\A 
P2\2 



-0, 



and 



= IP^] - 




(14a) 
(14b) 



(15) 



Thus, we see that the random variables A and B are 
not independent, and from Eqs. (fT4)) it follows that 
Bob's measurement outcomes are correlated with Alice's 
ones, but they are not perfectly correlated (see Fig. [2]). 
Now, we show how to quantify these correlations. We 
know that for any two random variables A and B (i) 
H{B\A) < H{B) with equality if and only if they are 
independent, and (ii) H{B\A) > with equality if and 
only if i? = f{A), i.e. A is perfectly correlated with B 
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FIG. 2: This diagram shows that the random variables A and 
B are not perfectly correlated in the information-theoretic 
sense. 
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FIG. 3: This diagram shows the perfect correlations, in the 
information-theoretic sense, between random variables A and 
B, A — f{B), despite the fact that the mutual information 
I{A : B) = H{A) ~ 0.918. 



in the information-theoretic sense. Therefore, it is clear 
that if H{B) > 0, then 

1 > H{B\A)/H{B) > 0. (16) 

Notice that this inequality can be rewritten in the fol- 
lowing form 



0<I{A: B)/H{B) < 1. 



(17) 



Therefore, the correlations between A and B can be mea- 
sured by I{A : B)/H{B). In the case under consid- 
eration, it can be shown that I{A : B) = log2 3 — | 
H{B) = log2 3 and therefore 



I{A : B) 



1 



log. 



2 3- 



(18) 



H{B) 

Assume now that first Bob performs a measurement 
of AIb and then Alice performs a measurement of Ma- 
If the measurement outcome of Mb is 6^, then the post- 
measurement state of the system is given by p'^f = {I ® 
\i){i\)p^^ {I®\i){i\)/pf . Therefore, the conditional prob- 
ability that Alice's outcome is aj provided that Bob's was 

bi isp^l^ — Tr[(|j)(j|®/)p^f ] while the joint probability 
that the measurement outcome of Ma and Mb is aj and 
6,, respectively is given by p^^^ = Tr[(|j)(j| ® \i){i\)p'^^]. 
It this case, the joint probabilities are given by (llSp while 
the conditional probabilities are as follows 



„A\B 




(19) 
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Thus, we see that Ahce's measurement outcomes are per- 
fectly correlated with Bob's ones (see Fig. Now, we 
explain why this is the case. We know that for any two 
random variables A and B (i) H{A\B) < H{A) with 
equality if and only if they are independent, and (ii) 
H{A\B) > with equality if and only if A = f{B), i.e. 
B is perfectly correlated with A. Therefore, it is clear 
that if > 0, then 



1 > H{A\B)/H{A) > 0. 



(20) 



Notice that this inequality can be rewritten in the fol- 
lowing form 



< /(A : B)/H{A) < 1. 



(21) 



Therefore, the correlations between A and B can be mea- 
sured by I {A : B)/H{A). In the case under considera- 
tion, it can be shown that I{A : B) = H{A) and therefore 



HA : B) 
H{A) 



= 1. 



(22) 



Thus, we see that the correlations between two ran- 
dom variables A and B corresponding to the measure- 
ment outcomes of Ma and Mb depend on the tempo- 
ral order of the measurements performed by Alice and 
Bob. Therefore, in order to capture all classical correla- 
tions that can be observed in the state (HH), we propose 
to define a measure of correlations between two random 
variables A and B in the following way 



C{A, B) = Max 



(I{A:B) I{A:B) 



I{A : B) 



H{B) 



Mm{H{A),H{B))' 



(23) 



Notice that in the case when a state p^^ has only classi- 
cal correlations the Shannon entropies are just equal to 
the von Neumann entropies and from Eqs. ([4]) and ([23|l 
it follows that 



T(p--) 



Minis (pA), SipB))- 



(24) 



Thus, we see that total correlations of a bipartite quan- 
tum state p^^ should be quantified by p4)) instead of 
quantum mutual information alone, at least for the clas- 
sically correlated quantum states. 



IV. CONCLUSION 



In this paper, we have shown that for bipartite quan- 
tum systems there exist quantum states for which quan- 
tum mutual information cannot be considered as a proper 
measure of total correlations, understood as the correla- 
tions between the measurement outcomes of two local ob- 
servables. Moreover, for these states we have proposed 
a different way of quantifying total correlations, which 
takes into account that the correlations can depend on 
the temporal order of the measurements. 
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